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FOREWORD 


This  research  was  conducted  within  independent  research  subproject  RROOO-0 1-042- 
04-025  (Approaches  to  Multiple  Objective  Assignment),  under  the  mission  sponsorship  of 
the  Navy  Personnel  Research  and  Development  Center,  and  exploratory  development 
subproject  RF-63-521-804-031  (Career  Management  Planning),  under  the  mission  sponsor- 
.  ship  of  the  Office  of  the  Chief  of  Naval  Research.  The  objective  of  these  projects  is  to 
develop  new  technologies  to  improve  the  Navy's  personnel  assignment  system. 

This  report  is  the  third  in  a  series  resulting  from  these  projects.  Previous  reports 
described  a  network  optimization  approach  to  solve  the  Navy's  personnel  assignment 
problem  (NPRDC  TR  84-49)  and  a  network  model  for  use  in  estimating  permanent  change 
of  station  (PCS)  costs  incurred  in  the  assignment  process  (NPRDC  TR  84-52).  This  report 
describes  an  alternative  computer  algorithm  for  solving  the  Navy's  assignment  problem  in 
particular,  and  any  assignment  problem  with  a  many  side  constraint,  in  general. 

The  heuristic  "search-by-chain"  algorithm  described  will  prove  useful  as  a  check  on 
the  quality  of  solutions  to  the  Navy's  assignment  problem  that  are  based  on  a  network 
with  side  constraints.  These  solutions  are  also  obtained  by  heuristic  procedures.  This 
report  should  be  of  interest  to  researchers  working  on  large-scale  optimization  problems 
that  require  integer  solutions. 


B.  E.  BACON 
Captain,  U.S.  Navy 
Commanding  Officer 


JAMES  McMICHAEL 
Technical  Director 


v 


SUMMARY 


Problem 

Nonstandard,  or  "side,"  constraints  make  optimal  solutions  to  the  Navy’s  personnel  assignment 
problem  difficult  to  compute.  These  constraints  can  vary  from  the  balance  of  personnel  assets  among 
fleets  to  school  quotas  for  training  en  route  to  a  new  assignment  Recently,  a  capacitated  transshipment 
model  formulation  and  computationally  efficient  network  flow  algorithm  solved  part  of  the  Navy’s 
assignment  problem.  In  addition,  in  order  to  solve  more  complicated  assignment  problems,  we  are 
modifying  a  general  network  algorithm  to  incorporate  some  types  of  side  constraints.  However,  the 
algorithm  is  limited  in  its  ability  to  consistently  produce  optimal  integer  solutions. 

Objective 

The  objective  of  this  effort  was  to  develop  an  alternative  approach  and  computer  algorithm  for 
solving  the  Navy’s  assignment  problem,  in  particular,  and  an  assignment  problem  with  a  large  number 
of  side  constraints,  in  general. 

Approach 

Using  the  "penalty  relaxation"  method,  we  converted  the  assignment  problem  with  side  constraints 
to  a  classical  assignment  problem  with  a  nonlinear  objective  function.  This  approach  consisted  of  two 
steps.  The  first  step  generates  an  initial  solution  that  is  close  to  optimal  by  using  an  approach  developed 
in  Kuhn’s  (1953)  Hungarian  assignment  algorithm.  The  second  step  improves  the  initial  solution  by 
modifying  the  search-by-tree  to  a  method  of  searching  among  feasible  solutions  by  chain. 

Results  and  Discussion 

For  the  Navy’s  assignment  problem,  formulated  as  a  capacitated  transshipment  model,  the 
presented  algorithm,  written  in  FORTRAN,  takes  5  percent  to  30  percent  more  computing  time  than  the 


vii 


computationally  efficient  network  code.  However,  the  algorithm  has  much  more  flexibility  and  the 
potential  to  incorporate  more  side  constraints,  and  therefore  to  handle  more  complex  Navy  assignment 
problems. 

Recommendation 

Future  development  should  concentrate  on  making  the  algorithm  more  computationally  efficient 
by  using  more  advanced  computer  languages,  such  as  assembly  and  C.  The  algorithm  should  be 
developed  concurrently  with  and  as  an  alternative  to  network  approach. 
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INTRODUCTION 


Background 

Matching  people  to  jobs  in  the  Navy  is  a  large  combinatorial  problem  that  is  further  complicated 
by  nonstandard,  or  "side,”  constraints.  One  set  of  constraints  concerns  allocation  goals  for  balancing 
personnel  assets  among  fleets,  priority  jobs,  sea  and  shore  duty,  and  male  only,  female  only,  and 
mixed-gender  jobs.  Other  side  constraints  include  advanced  training  school  quotas  for  training  en  route 
to  a  specialized  skill  assignment  and  permanent  change  of  station  budget  restrictions.  These  con¬ 
straints  make  the  Navy  assignment  problem  less  amenable  to  standard  optimization  techniques.  Early 
attempts  to  solve  the  problem  used  classical  linear  or  special  linear  integer  programming  codes.  These 
codes  were  hampered  by  limitations  on  the  amount  of  constraints,  the  amount  of  computer  processing 
time,  and  the  unreliability  of  integer  solutions  (i.e.,  in  assigning  a  whole  person  to  a  whole  job). 

Problem 

Commercial  codes  are  available  for  solving  the  assignment  problem  using  the  network  approach 
(Glover,  Kamey,  Klingman  &  Russel,  1978;  Jensen  &  Barnes,  1980;  Glover,  Klingman  &  Ross  1973b; 
Kamey  &  Klingman,  1976;  Mulvey,  1978)  or  the  transportation  approach  (Chames  &  Cooper,  1961; 
Glover,  Klingman  &  Russel,  1973a).  In  both  approaches,  an  assignment  problem  is  embedded  in  a 
more  general  class  of  special  integer  linear  programming  problems,  for  which  well  known  computa¬ 
tional  methods  exist  Unfortunately,  these  approaches  do  not  work  when  an  assignment  problem  con¬ 
tains  side  constraints. 

Recently,  a  capacitated  transshipment  model  formulation  (Liang,  1984;  Liang  &  Lee,  1985)  and 
computationally  efficient  network  flow  algorithms  (Bradley,  Brown  &  Graves,  1977;  Kennington  &  Hel- 
gason,  1980)  solved  part  of  the  Navy’s  assignment  problem  by  heuristically  incorporating  all  allocation 
goals  as  transshipment  arcs  and  avoiding  the  creation  of  side  constraints.  In  addition,  these  models 
modify  the  general  network  algorithm  to  incorporate  school  quotas  for  en  route  training.  However,  algo¬ 
rithms  of  this  type  (Barr,  Farhangian  &  Kennington,  1986;  Chen  &  Saigal  1977)  require  further 
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development  to  consistently  obtain  optimal  integer  solutions.  Other  approaches  need  to  be  investigated 
to  solve  the  Navy’s  assignment  problem. 

Objective 

The  objective  of  this  effort  was  to  develop  an  alternative  approach  and  computer  algorithm  for 
solving  the  Navy’s  assignment  problem  and,  in  general,  an  assignment  problem  with  a  large  number  of 
side  constraints. 


MODEL  FORMULATION 


Classical  Assignment  Problem 

The  classical  assignment  problem  consists  of  choosing  a  position  for  every  one  of  n  persons 
among  n  opportunities  under  the  condition  of  minimizing  total  cost  of  all  assignments.  For  every  person 
i  and  job  j ,  there  is  a  cost  ci;  of  assigning  the  person  i  to  the  job  j.  An  optimal  assignment  should 
provide  a  minimum  total  cost  for  n  persons. 

In  mathematical  terms,  the  problem  is 


min 

ij 

=  1 
i=  1 

A 

K 

II 

(1) 

rH 

n 

Ax 

i  =  l,...^i , 

(2) 

where  xi;  e  ^1,0^.  When  person  i  is  assigned  to  job  j ,  xtj  =  1;  otherwise  x,j  =  0.  Equations  (1)  and  (2) 
insure  that  one  person  is  assigned  to  each  job  and  one  job  is  assigned  to  each  person,  respectively. 

The  above  problem  is  an  integer  linear  programming  problem  with  a  unimodular  matrix.  The  uni- 
modularity  of  the  constraint  matrix  of  a  linear  programming  problem  means  that  any  basic  feasible 
solution  of  the  problem  is  integer.  Special  algorithms  have  been  built  to  efficiently  solve  this  problem, 
as  mentioned  earlier  in  this  report. 


-2- 


Assignment  Problem  With  Side  Constraints 


A  good  example  of  an  assignment  problem  with  side  constraints  is  the  Navy  assignment  problem. 
The  side  constraints  of  the  Navy  assignment  problem  may  cause  the  constraint  matrix  to  lose  its  uni¬ 
modularity  property,  so  the  special  assignment  or  transportation  algorithms  should  not  be  used.  The  side 
constraints  for  setting  allocation  goals  for  balancing  personal  assets  among  various  dimensions  were  first 
documented  in  Blanco,  Liang,  Habel,  and  Ritter,  1984  and  developed  in  Liang  and  Thompson,  1986. 
Rather  than  formulating  this  complex  problem  as  a  capacitated  transshipment  model  and  using  a  net¬ 
work  code  as  documented  previously,  we  converted  this  problem  to  an  assignment  problem  with  a  non¬ 
linear  objective  function  using  a  "penalty  relaxation"  method. 

In  the  case  of  the  Navy  assignment  problem,  all  jobs  are  divided  into  k  major  groups,  depending 
on  some  characteristics,  or  parameters,  of  the  job  (billet).  These  parameters  include  gender  require¬ 
ments,  duty  requirements  and  general  type  of  job.  Some  of  the  major  groups  should  be  filled  at  least 
with  a  minimal  manning  percentage;  others  should  be  filled  at  most  with  a  maximal  manning  percen¬ 
tage.  In  every  major  group,  there  is  an  additional  splitting  of  jobs  into  /  subgroups,  defined  by  different 
fleets  (we  will  assume  that  l  =  3).  The  manning  percentage  of  different  subgroups  belonging  to  the 
same  major  group  should  be  balanced. 

As  a  rule,  the  amount  of  available  jobs  m  is  more  than  the  amount  of  available  people  n ;  and  not 
all  people  are  eligible  for  every  job.  Without  loss  of  generality,  we  assume  that  every  person  is  eligible 
for  every  job.  In  the  case  of  assigning  a  person  to  a  job  for  which  he  or  she  is  not  really  eligible,  we 
give  the  cost  ci}  of  this  assignment  as  M ,  where  M  is  a  rather  big  number  (penalty)  for  wrong  assign¬ 
ment 

Let  Sr  be  the  set  of  all  jobs  for  a  major  group  r ,  where 

S,  c  -{l,...,m  k  r  =  1,...,* 

r=k 

uSr 

r=l 

Let  1 1  be  the  set  of  groups  that  need  to  be  filled  with  a  minimal  manning  percentage,  where 
I i  c*{  .  Then  for  r  el x  we  have  constraints: 
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(3) 


where  VT  is  the  amount  of  billets  authorized  for  group  r ;  and  Pr  is  the  current  manning  of  the  group. 
Here  and  below  we  assume  that  in  summation,  index  i  goes  from  1  to  n  if  not  stated  directly  other¬ 
wise. 

In  the  same  way,  if  /2  is  the  set  of  groups  that  need  to  be  manned  at  not  more  than  100  percent 
and  r  e/2,  then 


(4) 


There  are  two  meta  groups  of  jobs  that  also  have  minimal  manning  percentage  constraints.  These 
groups  are  jobs  to  be  filled  by  males  or  females  only.  If  JXt  J2  are  sets  of  jobs  required  to  be  filled  by 
males  and  females  respectively,  we  can  write  an  analog  of  constraint  (3)  for  this  group,  as  follows: 


(5) 


Here  Wk  is  the  number  of  billets  authorized  in  the  group  Jk  (k  =  1,2),  and  Uk  is  the  current  manning  of 
the  group. 

To  work  with  equal  manning  percentage  requirements  between  subgroups  of  the  same  major 
group,  let  us  denote  Srt  as  the  set  of  jobs  in  the  group  r  for  fleet  /  (/  =  1,2,3).  Obviously 
Srl  uSr2  uSr3  =  Sr\  r=l,...^.  Let 


(6) 


In  this  equation,  Vrt  is  the  number  of  billets  authorized  for  the  rl  group,  and  is  the  current  manning 
of  the  group. 


Also  denote: 


(7) 


Then  our  problem  is  to  minimize  the  distance  Mr  -  mr.  Let  x+  be  a  convex  function: 


x  if  x  £  0 
0  if  x  <  0 


Putting  together  constraints  (3)  through  (7),  we  can  write  the  objective  function: 
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(8) 


Q  =  IfijXu  +  ?ixfV*  -  *4  -  SI XijT  +  <?2x I(vr-/>r-XZ *,7)+  + 

*  J  ^  f  €/j  1  y€iSr 


+  ?  jX  S  (S  S  xij  -  Vr  +  Fr)+  +  ?4X  S  (Afr  -  m,). 

r*/2  i  y«5r  r=l 

This  should  be  minimized  under  the  constraints  (1)  and  (2).  Here  qlt  q2,  q3  and  qA  are  penalty 
coefficients  for  not  meeting  corresponding  constraints.  Because  we  have  more  jobs  than  people,  instead 
of  the  constraint  (2)  we  should  have 


s  1;  j  =  1  ,-/n.  (2a) 

i=l 

Note  that  substituting  of  an  inequality  (2a)  for  the  equality  (2)  is  not  very  essential  because  we  always 
can  add  m  -  n  new  fictitious  persons,  which  will  give  zero  input  in  the  objective  function  (8)  (i.e.  c,y  = 
0  for  them).  Therefore  we  will  not  change  the  main  problem  but  return  to  equality  (2). 


SOLUTION  TECHNIQUES 


Hungarian  Method  to  Solve  the  Classical  Assignment  Problem 

Kuhn’s  1953  approach  to  solve  the  classical  assignment  problem  is  used  for  getting  an  initial 
solution  in  our  algorithm.  Kuhn’s  method  is  a  primal-dual  method;  we  describe  the  dual  problem  for  the 
original  assignment  problem  shown  in  (1),(2).  The  dual  problem  is 


subject  to 


max  +  £v,-, 
<=i  >=i 


Ui+Vj  <£Lj ;  (10) 

where  u,  and  Vj  are  dual  variables  that  are  to  some  extent  potential  weights  of  the  importance  of  the  i- 
th  person  or  the  j-lh  job  for  assignment  From  the  theory  of  duality,  it  is  known  that  if  we  find  a  set  of 

potentials  •(ti, \,  satisfying  inequality  (10)  and  a  set  of  satisfying  equalities  (1),(2)  that  relate  to 
each  other  by  the  equality 

(cij  -  Uj  -  Vj)  xxij  =  0;  i  J=l,..n ,  (H) 

then  uit  vj,  xu  are  an  optimal  solution  for  both  the  dual  and  original  problems,  respectively.  The 
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equality  (11)  is  a  complementary  slackness  condition.  There  is  one  feasible  solution  satisfying  the  dual 
constraints  (10): 

Ui  =  min  iqj  }•  (12) 

Vj  =  min  \dj  -  ^  (13) 

In  other  words  first  we  calculate  the  minimum  by  row  to  get  u;  in  equality  (12)  and  then,  subtracting 
these  minimums  from  corresponding  rows  of  the  cost  matrix  and  taking  the  minimum  by  column,  we 
get  Vj .  This  process,  together  with  checking  the  complementary  slackness  conditions  (1 1),  gives  rise  to 
the  Hungarian  algorithm.  In  this  algorithm,  beginning  from  the  original  cost  matrix  \cy  K  we  deduce  a 
reduced  cost  matrix  Ifiy  )•  whose  elements  are  calculated  as  follows: 

From  every  element  of  a  row,  we  will  subtract  the  minimum  element  of  this  row;  and  then  from 
every  element  of  a  column,  we  will  subtract  minimum  element  of  this  column.  This  process  corresponds 
to  the  equalities  (12),(13)  for  creating  a  feasible  dual  solution.  After  this  process  we  will  get  a  reduced 
matrix  {ty  }•  that  contains  many  zero  elements.  Zero  elements  constitute  a  covering  set  if  in  every  row 
and  in  every  column  there  is  at  least  one  zero;  and  in  any  submatrix  that  is  organized  by  taking  off  the 
row  and  the  column  corresponding  to  an  element  of  the  covering  set,  the  subset  of  the  covering  set  is 
also  a  covering  set  Choosing  Xy  =  1  in  the  places  of  those  zeroes  that  constitute  a  covering  set,  we 
satisfy  the  equalities  (11),(1),(2);  and  we  get  an  optimal  solution.  However,  if  the  reduced  matrix  does 
not  have  this  covering  set  of  zeroes,  there  is  a  process  for  successive  matrix  reduction,  which  is 
described  in  Bazaraa  and  Jarvis  (1977).  The  case  of  no  covering  set  of  zeroes  is  much  more  compli¬ 
cated  than  the  original  process  (12), (13).  The  reduction  process  mentioned  above  requires  the  applica¬ 
tion  of  network  optimization  or  some  another  technique,  which  is  a  big  drawback  for  the  original  Hun¬ 
garian  method. 

One  difficulty  in  this  method  occurs  when  the  reduced  matrix  has  more  than  one  zero  in  a  row: 
which  one  should  be  used  in  the  covering  set?  Analysis  of  the  algorithm  shows  that  this  decision 
depends  on  non-zero  values  in  the  corresponding  columns  of  the  reduced  matrix.  In  most  cases  a  zero 
element  in  the  reduced  matrix  will  correspond  to  solution  Xy  =  1  if  min  iy  is  bigger,  where  5,  is  the 

I  €  5  j 

set  of  non-zero  elements  in  the  row  j .  This  property  leads  to  the  gradient  approach  for  getting  an  initial 
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solution.  In  other  words,  the  method  of  finding  an  initial  solution  consists  of  finding  a  person  with 
maximal  distance  between  "minimizing  job"  and  "next  to  minimizing  job"  for  him,  where  we  measure 
distance  in  the  sense  of  difference  between  job  costs. 

Gradient  Approach  to  Initial  Solution 

Let  us  call  a  gradient  for  a  person  i  in  the  job  j2  with  respect  to  the  job  ji  the  difference 
c‘j2  ~  c*7r  ^ien  gradient  method  of  finding  an  initial  solution  consists  first  of  finding  for  a  person  i 
a  job  that  provides  a  minimal  but  not  a  zero  gradient  with  respect  to  minimizing  job  j.  Then  we  find 
the  maximum  of  all  these  gradients  among  all  persons  and  assign  this  person  to  a  minimizing  job.  Next 
we  describe  this  process  more  exactly  and  calculate  the  complexity  of  this  part  of  the  algorithm,  in  the 
sense  of  the  amount  of  elementary  operations  necessary  fcsr  getting  an  initial  solution. 

For  each  person  i ,  denote  as  7"  the  set  of  jobs  j  i  such  that 

(14) 

In  other  words,  7*  is  the  set  of  minimizing  jobs  for  a  person  i.  Define 

A.  (i )  =  min(clV  -  c,7i);  jxej?.  (15) 

}V? 

A*(i)  is  the  gradient  for  a  person  i  with  respect  to  a  minimizing  job.  If  n  *  1  and  jobs  are  of  varying 
costs,  then  gradient  A*(i)  >  0,  because  in  equality  (15)  we  have  j <£/*.  Finally  we  define  a  set  /„  as  a 
set  of  i  j  such  that 

M/i)  *  MO;  i  y  (16) 

In  other  words,  IH  consists  of  persons  who  maximize  their  minimal  gradient,  as  defined  in  equality  (15). 
Calculating  the  initial  solution  consists  of  assigning  to  a  person  ixeln  a  job  .  Then  after 

subtracting  person  jj  and  job  j  j  out  of  sets  of  all  available  persons  and  jobs,  we  repeat  this  process 
until  we  get  an  assignment  for  each  person.  If  we  denote  as  d  a  constant  for  estimating  computing  time 
for  comparison  and  subtraction,  then  following  inequality  (14),  the  calculation  of  jx  g  7"  will  take  not 
more  than  nxd  time.  The  calculation  of  A *(/')  will  require  not  more  than  nbid  time,  and  calculation 
of  ijE/*  will  require  not  more  than  n\d  time.  The  whole  calculation  of  an  initial  solution  will  take 
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not  more  than 


(n3  +  (n  -  l)3  +  (n  -2)3+...)xd  ZCxn*  (17) 

computer  time,  where  C  is  a  constant.  The  estimation  (17)  can  be  considerably  improved  in  practical 

calculations  if  we  save  a  list  of  minimizing  jobs  in  (14)  and  (15)  for  every  person  for  the  next  round  of 

calculations. 

If  a  reduced  matrix  in  the  Kuhn  method  has  only  one  zero  in  every  row  and  in  every  column, 
then  the  above  initial  solution  will  coincide  with  an  optimal;  but  there  are  also  other  cases  when  this 
occurs. 

Let  ji  €  jp  and  /*_!  =  ^l,...,n  <{7^.  That  is,  is  set  of  all  jobs  except  ju  which  is  already 

used  for  a  person  z.  As  in  inequality  (14)  let  J*~l  denote  a  set  of  all  jobs  j2  such  that 

Cij  2  —  £», /  J  ^  /■— 1  (18) 

We  call  a  cost  matrix  monotone  at  step  1  if  /*“'  c  J*  for  all  1.  If  a  matrix  is  monotone  at  step  1, 

then  taking  person  i  x  and  the  job  j  j  out  of  the  available  sets  of  persons  and  jobs,  respectively  we  can 

define  a  matrix  as  monotone  at  step  2  by  analog  with  the  previous  definition.  The  cost  matrix  is  fully 

monotone  if  it  is  monotone  at  all  (n  -  1)  steps.  An  example  of  a  fully  monotone  matrix  is 

4  444 
8  3  3  3 
4  8  22’ 

7  6  5  1 

Really,  if  the  first  person  will  choose  the  first  job  that  belongs  to  J  f,  it  does  not  affect  the  amount  of 
minimizing  jobs  for  other  persons.  The  same  consideration  is  true  for  other  persons.  In  the  above  case, 
the  reduced  matrix  has  more  than  one  zero  in  a  row. 

Lemma  1.  If  the  cost  matrix  of  an  assignment  problem  is  fully  monotone,  the  initial  solution  coin* 
cides  with  an  optimal  solution. 

(The  proof  of  this  lemma  as  well  as  others  is  in  the  appendix). 

There  is  another  case  of  coincidence  of  an  initial  solution  with  an  optimal  solution. 

Let  us  consider 


-8- 


(19) 


5,(i)  =  max  (Cy-Cy  );  jx  e  7,". 

That  is,  5,(/)  is  the  maximum  of  all  distances  between  costs  for  a  person  i .  Let 

8*(i)=  ..  .  (cv  “  cv,)»  (20) 

where  is  the  job  assigned  to  person  ik  at  step  k  of  the  initial  solution  algorithm.  In  equality  (20)  we 
assume  that  /  e-{l,..„n  )•- -{iu...Jk^y,  that  is,  person  i  is  not  assigned  yet  The  value  5 k(i)  is  analogous 
to  5,(/)  in  (19)  at  the  step  k  of  the  initial  algorithm. 

Lemma  2.  Let  be  one  element  set,  and  let 

A»-*+i(4)  £  6,_*+i0  ) 

for  k-  k  then  an  initial  solution  coincides  with  an  optimal  solution. 


An  example  of  this  kind  of  cost  matrix  is: 

1  11  21 ' 

12  17  22  . 

3  5  7. 

Really,  in  this  case  i,  =  1.  We  have  A3(l)  =  10,  and  63(2)  =  10;  5j(3)  =  4;  ^(2)  =  5,  and  S^)  =  4. 
In  other  words,  on  every  step  of  the  algorithm,  a  gradient  for  the  assigned  person  is  rather  big  compared 
with  all  gradients  in  the  remaining  part  of  cost  matrix. 

The  described  cases  show  that  the  initial  solution  calculated  by  the  gradient  approach  is  some¬ 
times  an  optimal  solution.  In  addition,  the  gradient  approach  provides  the  assignment  of  a  minimizing 
job  to  a  person  on  every  step  of  the  algorithm  in  such  a  way  that  substitution  of  this  assignment  to 
another  will  be  blocked  by  getting  an  additional  cost  that  is  equal  to  the  correspondent  gradient  By 
choosing  a  maximization  of  the  gradient  as  a  rule  for  initial  assignment,  we  can  expect  closeness  of  the 
initial  assignment  to  an  optimal  solution.  In  all  our  testing,  we  do  get  this  expected  closeness. 

Using  a  more  complicated  initial  solution  algorithm,  we  can  get  more  cases  where  the  initial 
solution  coincides  with  an  optimal  solution.  However,  we  found  that  it  is  not  worthwhile,  because  it 
will  lead  to  considerable  increase  in  computational  time  without  much  compensation  in  the  second  part 
of  the  algorithm. 
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The  described  initial  solution  algorithm  can  be  easily  adjusted  for  the  assignment  problem  with 
side  constraints  by  using  penalty  relaxation.  To  do  this  we  have  to  recalculate  costs  in  formulas  (14)  - 
(15),  corresponding  with  a  new  objective  function.  Due  to  the  nonlinearity  of  the  objective  function, 
this  recalculation  should  be  done  during  calculations  of  corresponding  minim  urns  and  maximums. 

Searching  by  Improving  Chains 

For  cases  where  initial  solutions  calculated  by  the  gradient  approach  do  not  coincide  with  an 
optimal  solution,  we  developed  a  second  algorithm  for  improving  the  initial  solution.  Below  we 
describe  this  "improving  part." 

Any  assignment  can  be  expressed  as  a  vector  K  where  jk  is  a  job  assigned  to  person 

k.  Two  assignments  ^  and  differ  on  elementary  permutation  if 

iii  v-Jr'.-J*  »-J»  In  Other  words,  in  the  assignment  persons  r  and  k 

changed  their  jobs  with  respect  to  original  assignment  -{jf  ....j,1  )■.  To  return  from  assignment 
person  r  should  change  jobs  with  person  k  \  in  other  words,  there  is  a  chain  of  length  one  connecting 
these  two  assignments.  We  denote  the  elementary  permutation  that  corresponds  to  the  described  above 
chain  of  length  one  as  (r  Jc).  If  the  assignment  {j? ,—J?}  differs  from  the  original  assignment 
ijl .  ■  ■  ■  ,jn  Mn  two  elementary  permutations  (kj),(s/),  then  we  say  that  these  assignments  differ  in 
a  chain  of  length  two.  In  this  case,  to  restore  the  original  assignment  from  the  new  ij\  requires 

at  least  three  different  persons.  Chains  of  length  three,  four  and  so  on  connecting  two  given  assignments 
can  be  defined  in  the  same  way. 

Consider  an  assignment  \ji  We  say  that  there  is  an  improving  chain  of  length  k  if  there  is 

an  assignment  -{jf  with  a  cost  less  than  the  original  assignment  and  that  connects 

with  the  original  assignment  by  a  chain  of  length  k .  Any  two  assignments  can  be  connected  by  chains 
of  elementary  permutations. 

Lemma  3.  If  the  assignment  ^  is  not  optimal,  there  is  an  improving  chain  of  length 

k  <,  n. 
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We  will  present  two  examples  of  the  application  of  searching  by  chains  in  the  next  section. 

To  find  all  improving  chains  of  length  k,  we  should  check  C*  possible  chains,  which  gives  an 
exponential  estimation  of  effectiveness  for  an  optimizing  algorithm  based  on  Lemma  3.  However,  this 
estimation  can  be  considerably  improved  based  on  the  following  consideration: 

Lemma  4.  If  for  assignment  ^  there  is  an  improving  chain  of  length  one,  then  there  is  an 

elementary  permutation  (rjc)  such  that  cri  >  cri . 

Jr  rJk 

In  other  words,  under  the  lemma’s  condition  for  a  person  r ,  there  is  a  job  jk  that  differs  from  the 

job  jr  assigned  to  him  and  that  costs  less.  The  same  kind  of  property  exists  for  improving  chains  with 
lengths  of  more  than  one. 

If  the  cost  matrix  satisfies  some  additional  properties,  the  amount  of  time  for  the  chain  part  of  the 
algorithm  can  be  cut  further.  But  even  a  simple  property  like  Lemma  4,  together  with  a  good  initial 
solution,  will  dramatically  help  decrease  computational  time.  We  found  that  stopping  after  checking 
improving  chains  of  length  one  and  two  almost  always  gives  an  optimal  solution. 

As  in  the  case  of  the  initial  solution  part  of  the  algorithm,  this  part  can  be  easily  applied  for 
penalty  relaxation  of  an  assignment  problem  with  side  constraints.  Again,  due  to  non-linearity  of  the 

objective  function,  correction  of  costs  should  be  done  at  the  time  of  checking  for  corresponding  improv- 
ing  chains. 


NUMERICAL  EXAMPLES 


In  this  section  we  will  demonstrate  the  work  of  the  algorithm  first  without  side  constraints  and 
then  with  side  constraints.  The  example  will  be  for  the  cost  matrix: 


12  16  20  16 
9  12  15  16 

6  8  10  16 
3  4  5  9 

The  calculation  of  an  initial  solution  takes  three  steps. 


(21) 
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At  Step  1  from  the  cost  matrix  (21)  we  have 


12=  min  Ci/; 

7=1.13.4  1 

AP  =  4; 

9=  min  c2.; 
7=1.13.4  1 

AP=3; 

6=  min  c3(; 

7=1  A3, 4 

Aj!)  =  2; 

3  =  min  c4,-; 

7-1A3.4  1 

Ai«  =  1. 

Here  A/4>  is  the  maxmin  gradient,  which  is  defined  in  the  gradient  approach  process  for  a  person 
i  =  1,2,3, 4  at  step  k.  Due  to  the  definition  of  the  gradient  approach,  we  will  get  j\  =  1  and  the  new 
cost  matrix  for  assigning  three  persons  to  three  jobs.  The  new  matrix  is  part  of  the  original  matrix: 

n  w  m  nf> 

p  12  15  16 
$  8  10  16  • 

2  4  5  9 

Here  we  crossed  out  elements  that  do  not  participate  in  the  next  steps. 

At  Step  2  we  have 

12=  min  c2/;  Ap  =  3; 

7=13.4  ' 

8=  min  c3.;  AP  =  2; 

7=13.4 

4  =  min  c4i;  AP  =  1. 

7  =2,3,4  ‘ 

From  this  we  will  get  y2  =  2  and  the  new  cost  matrix  (for  two  persons  and  two  jobs)  which  is  a  part  of 
the  original  matrix: 

n  vf>  m  w 
9  vim  w 
6  8  10  16  ■ 

2  4  5  9 

At  Step  3: 

10  =  minc3;;  AP  =  6; 

5  =  minc4.;  AP  =  4; 

y= 3,4 

and  j3  =  3,  >4  =  4.  Finally,  the  initial  solution  is  j j  =  1,  ;2  =  2,  ;3  =  3,  jA  -  4;  and  we  are  ready 
for  the  improving  part  of  the  algorithm. 
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We  begin  with  searching  chains  of  length  one.  For  person  1  we  have  a  minimizing  assignment; 
so  due  to  Lemma  4,  there  are  no  improving  chains.  Again  due  to  Lemma  4,  for  person  2  there  is  only 
one  "suspicious"  element,  c2 because  9  =  c2i<C22=c2/2  =  12.  Because  the  first  job  due  to  the  initial 

solution  is  assigned  to  person  1,  the  corresponding  chain  to  be  checked  for  improving  the  assignment  is 
(2,1).  But  for  this  chain  we  have 

Cu  +  C22  =  c i jx  +  c2y2  =  12  +  12  <  c2i  +  Cj2  =  9  +  16. 

Therefore  this  chain  is  not  improving.  For  person  3  there  are  two  suspicious  elements,  c31  and  c32, 

which  give  rise  to  two  chains  (3,1)  and  (3,2)  which  are  not  improving.  At  last,  for  person  4  there  are 

three  suspicious  elements,  c4 lt  c42,  and  c43,  which  yield  three  chains  (4,1),  (4,2)  and  (4,3),  from  which 

the  first  and  the  second  are  improving. 

c  1 1  +  c 44  =  C\jx  +  c4jt  =  12  +  9  >  C41  +  c  14  =  3  +  16. 

c72  +  c44  ~  C2;2  +  C4j4  =  12  +  9  >  C42  +  C2A  =  4  +  16. 

Using  the  improving  chain  (4,1),  we  will  get  a  new  solution:  solution  j'i  =  4;  j2  =  2;  ;3  =  3;  j4  =  1. 

Beginning  from  this  solution  we  have  for  the  first  person  a  suspicious  chain  (1,4);  for  the  second  per¬ 
son,  the  suspicious  chain  (2,4);  and  for  the  third  person,  two  suspicious  chains,  (3,4)  and  (3,2).  The 
chain  (2,4)  for  person  2  is  improving,  and  using  this  we  get  a  new  solution 
j\  =  4;  j2  =  1;  j3  =  3;  j 4  =  2.  After  that  we  can  find  that  the  chain  (3,4)  for  person  3  is  improving,  and 
using  this  chain  we  get  the  solution:  j  j  =  4,  j2  =  1,  j3  =  2,  j4  =  3.  Because  there  aren’t  more  improving 
chains,  this  solution  is  an  optimal  solution. 

To  demonstrate  the  algorithm  for  the  side  constraints  case,  let  us  put  two  additional  constraints  on 
the  original  assignment  problem  with  cost  matrix  (21)  : 

*11  +  *22  +  *33  +  *44  ^  2, 

*21  +  *32  +  *43  -  2. 

The  penalty  relaxation  of  this  problem  will  be 

L  =  2 >«/*v  +  <7l(*ll  +  *22  +  *33  +  *44  -  2)+  + 
ij 

+  ?2(*21  +  *32  +  *43  ~  2)  +  . 

Let  us  assume  q ,  =  q2  =  -^-maxc,.  =  10  and  apply  the  algorithm  for  this  problem.  Note  that  the  side 

■4  i  j 
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constraints  are  made  in  such  a  way  as  to  exclude  the  original  initial  solution  as  well  as  the  original 
optimal  solution. 

The  first  two  steps  of  the  initial  solution  part  of  the  algorithm  will  go  without  any  effects  of 
added  side  constraints.  Then  at  Step  3  we  will  have 


16  =  min  ^33  +  10,  Af>  =  4; 

5  =  min  ^c43,  C44  +  10H  A|3)  =  14. 

Thus  we  will  get  the  initial  solution  j\  =  1;  j2  =  2;  73  =  4;  74  =  3.  In  the  improving  part  of  the  algo¬ 
rithm,  there  is  an  improving  chain  (13)  of  length  one  for  person  3,  which  will  lead  to  the  solution 
j  1  =  4,  72  =  2,  73=  1,  74  =  3.  The  suspicious  chain  (23)  for  the  second  person,  which  should  be 
improving  without  side  constraints,  now  is  not  improving,  due  to  the  second  term  in  the  penalty  objec¬ 
tive  function.  Because  there  are  no  more  improving  chains,  this  solution  is  optimal. 

Now  we  present  an  example  that  is  a  slight  modification  of  example  (21),  which  has  no  improv¬ 
ing  chain  of  length  one  but  has  an  improving  chain  of  length  two. 


J2  16  20  19 
9  12  15  16 
6  8  IQ  16 

3  4  5  2 


(22) 


As  in  the  case  of  cost  matrix  (21)  the  initial  solution  will  be  the  same:  j\  =  1,  j2  =  2,  73  =  3,  jA  =  4; 


but  chains  (1,4)  and  (4,3),  which  were  improving  in  the  case  of  matrix  (21)  are  not  improving  now 


because 


c u  +  C44  —  c 37 j  +  cAj^  —  12  +  9  <  C41  +  c  14  —  3  +  19. 

+  C44  =  c2j1  +  cAJa  =  12  +  9  <  c42  +  C24  =  4  +  19. 

There  are  no  improving  chains  of  length  one,  but  there  is  an  improving  chain  (4,1),  (1,3)  of  length  two: 

ctt  +  C33  +  C44  =  c2j2  +  c 3y3  +  cAja  =  12  +  10  +  9  >  c14  +  C43  +  C3!  =  19  +  5  +  6. 

Using  this  improving  chain,  we  get  the  solution  =  4,  j2  =  2,  73=1,  jA  =  3.  Applying  to  this  solu¬ 

tion  the  improving  chain  (2,3),  we  get  an  optimal  solution  7,  =  4,  j2  =  1,  73  =  2,  jA  =  3. 
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COMPUTATIONAL  RESULTS  AND  COMPARISON  WITH  THE  NETWORK  APPROACH 

The  algorithm  was  written  in  FORTRAN  language  for  an  IBM4341/12  using  the  CMS  operation 
system.  There  are  two  versions  of  the  algorithm  that  differ  in  the  precision  or  the  amount  of  digits 
needed  for  the  presentation  of  the  elements  of  the  cost  matrix.  The  first  version  is  constrained  by 
presenting  costs  as  integers  occupying  not  more  than  four  bytes  in  binary  presentation  (i.e.,  as  standard 
integers  in  FORTRAN).  This  algorithm  has  no  constraints  on  the  length  of  improving  chains  and 
minimal  constraints  in  selection  of  these  chains  in  the  improving  part  of  the  algorithm.  We  used  this 
program  to  compare  the  performance  of  the  algorithm  for  the  pure  assignment  problem.  In  all  comparis¬ 
ons  with  commercial  software  package  GNET  performance  for  the  same  problems,  we  found  the  com¬ 
putational  times  were  approximately  the  same.  Dimensions  of  constraint  matrices  of  explored  problems 
were  as  large  as  233.  We  will  not  spend  time  on  this  part  of  the  comparison  because  the  main  purpose 
of  the  project  was  to  develop  tools  for  solving  assignment  problems  with  side  constraints. 

The  second  version  of  the  algorithm  was  designed  to  compare  the  effectiveness  of  the  algorithm 
with  the  network  implementation  of  the  Navy  assignment  problem  for  nonrated  personnel  (Seaman,  Air¬ 
man,  Fireman,  and  Fireman  Apprentice;  this  is  described  in  the  Model  Formulation  section  of  this 
report  and  in  Liang  &  Thompson,  1986).  This  problem  is  computationally  aggravated  because  the  cost 
matrix  for  the  problem  has  elements  that  are  integers  occupying  up  to  12  bytes  in  binary  presentation. 
FORTRAN  has  no  special  mechanism  for  working  with  integers  this  large,  so  we  were  forced  to  use 
FLO  ATI  6  arithmetic  to  work  with  these  costs.  Since  FLOAT16  arithmetic  is  known  to  be  very  slow, 
we  were  forced  to  do  different  "tricks"  to  accelerate  the  speed  of  the  algorithm.  Along  with  the  cost 
matrix,  we  used  another  matrix,  elements  of  which  are  standard  FORTRAN  integers  and  equal  to  the 
order  between  different  costs.  This  matrix  was  used  for  comparing  elements  of  the  cost  matrix,  because 
comparing  FLOAT16  numbers  is  a  very  time-consuming  process.  In  this  version  of  the  algorithm,  we 
stopped  after  checking  improving  chains  of  length  2  in  the  improving  part  of  the  algorithm.  This 
appeared  to  be  quite  adequate  in  all  the  practical  examples.  Of  course,  using  improving  chains  of  length 
not  more  than  two  converts  this  algorithm  to  a  heuristic.  For  simplicity  reasons  we  made  all  penalty 
coefficients  in  (18)  equal  (i.e.  qx  =  q2  -  <?3  =  <?4  =  q),  and  we  measured  q  with  respect  to  max  c/y 
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where  the  maximum  is  based  on  the  eligible  combination  (i  J ).  We  found  that  increasing  the  penalty 
coefficient  with  respect  to  this  maximum  (Max)  yields  more  computational  time,  because  the  amount 
of  suspicious  chains  needing  to  be  checked  in  the  improving  part  of  the  algorithm  also  increases. 

Computational  results  are  presented  for  two  cases  in  the  following  tables.  The  first,  shown  in 
Tables  1.1,  1.2,  and  1.3,  on  page  17  describe  a  situation  where  81  persons  are  assigned  to  163  jobs.  All 
jobs  belong  to  one  major  group  and  two  minor  subgroups.  Due  to  the  manning  balance  constraint,  the 
manning  percentage  in  the  ideal  case  should  be  the  same  in  both  subgroups  and  was  reached  by  the 
algorithm  with  the  penalty  coefficient  of  1/2  Max.  Reaching  this  balance  increases  the  cost  of  the 
assignment. 

The  second  example,  presented  in  Tables  2.1,  2.2,  and  2.3  on  page  18,  exemplifies  72  persons 
who  should  be  assigned  to  145  jobs.  The  jobs  belong  to  three  different  major  groups.  The  first  major 
group  has  two  subgroups,  the  second  has  one  subgroup,  and  the  third  has  three  subgroups.  The  second 
major  group  is  constrained  by  the  maximal  manning  percentage  as  in  inequality  (4).  As  in  the  first 
example,  nearly  ideal  allocation  is  reached  with  the  penally  coefficient  equal  to  1/2  Max ;  but  this  time, 
the  cost  of  all  assignments  is  better  with  the  algorithm  application  than  with  the  network  code.  Some 
differences  in  allocations  with  the  network  approach  and  the  new  algorithm  solution  can  be  partly 
explained  by  making  all  penalty  coefficients  in  the  objective  function  (8)  equal. 
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GROUPS 

Vacancies 

People 
on  Board 

Manning 

Percentage 

Group  1,  Subgroup  1 

5681 

4184 

73.7% 

Group  1,  Subgroup  2 

5035 

3660 

72.7% 

Table  1.1 

Original  Data  (Example  1) 


GROUPS 

Allocation 

Manning 

percentage 

Group  1,  Subgroup  1 

17 

73.9% 

Group  1 ,  Subgroup  2 

64 

74% 

Cost 

10013001440276 

CPU  Time  in  Sec. 

28.1 

Table  1.2 

Network  Approach  (Example  1) 


1/200  Max 

1/5  Max 

1/2  Max 

GROUPS 

Alloc. 

Percent 

Alloc. 

Percent 

Alloc. 

Percent 

Group  1,  Subgroup  1 

24 

74.4% 

17 

73.9% 

16 

74% 

Group  1,  Subgroup  2 

57 

73.8% 

64 

74% 

65 

74% 

Cost 

10007751390055 

10014401454977 

1001545 

>1442724 

CPU  Time  in  Sec. 

29.3 

35.6 

38.2 

Table  1.3 

Algorithm  Results  (Example  1) 

Penalty  Coefficients  in  Terms  of  Maximal  Cost 
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GROUPS 

Vacancies 

People 
on  Board 

Manning 

Percentage 

Group  1,  Subgroup  1 

5663 

4184 

73.9% 

Group  1,  Subgroup  2 

5164 

3784 

73.3% 

Group  2 

159 

157 

98.7% 

Group  3,  Subgroup  1 

699 

309 

44.2% 

Group  3,  Subgroup  2 

1168 

522 

44.7% 

Group  3,  Subgroup  3 

1381 

609 

44.1% 

Table  2.1 

Original  Data  (Example  2) 


GROUPS 

Allocation 

Manning 

percentage 

Group  1,  Subgroup  1 

20 

74.2% 

Group  1,  Subgroup  2 

31 

73.9% 

Group  2 

2 

100% 

Group  3,  Subgroup  1 

5 

44.9% 

Group  3,  Subgroup  2 

2 

44.9% 

Group  3,  Subgroup  3 

12 

45% 

Cost 

8170251272896 

CPU  Time  in  Sec. 

17.1 

Table  2.2 

Network  Approach  (Example  2) 


1/200  Max 

1/5  Max 

1/2  Max 

GROUPS 

Alloc. 

Percent 

Alloc. 

Percent 

Alloc. 

Percent 

Group  1,  Subgroup  1 

20 

74.2% 

7 

74% 

7 

74% 

Group  1,  Subgroup  2 

28 

73.8% 

37 

74% 

37 

74% 

Group  2 

4 

101.3% 

4 

101.3% 

4 

101.3% 

Group  3,  Subgroup  1 

9 

45.6% 

10 

45.6% 

7 

45.2% 

Group  3,  Subgroup  2 

4 

45% 

4 

45% 

4 

45% 

Group  3,  Subgroup  3 

8 

44.7% 

10 

44.8% 

13 

45% 

Cost 

7925251285973 

7935751283523 

793645 

1310473 

CPU  Time  in  Sec. 

16.9 

21.5 

24.3 

Table  2.3 

Algorithm  Results  (Example  2) 

Penalty  Coefficients  in  Terms  of  Maximal  Cost 
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CONCLUSIONS 


The  search-by-chain  algorithm  achieved  an  objective  function  value  very  close  to  results  achieved 
by  GNET.  The  algorithm  used  5  percent  to  30  percent  (depending  on  value  of  penalty  coefficients) 
more  computational  time  than  the  GNET  algorithm  when  applied  to  a  few  examples  of  the  Enlisted 
Personnel  Allocation  and  Nomination  System  (EPANS)  model  for  nonrated  personnel.  Because  the 
EPANS  formulation  is  a  partly  heuristic  process,  it  is  reasonable  to  have  two  separate  algorithms  based 
on  different  approaches  to  check  the  quality  of  the  solution.  In  addition,  the  search-by-chain  algorithm 
is  more  flexible  for  incorporating  additional  side  constraints  to  handle  more  complex  Navy  assignment 
problems. 


FUTURE  DEVELOPMENT 

More  extensive  computational  comparisons  will  be  performed  in  the  future  on  more  complex 
Navy  problems,  particularly  ones  that  contain  multiple  school  quota  constraints.  In  addition,  the  algo¬ 
rithm  will  be  reprogrammed  in  more  advanced  computer  languages,  such  as  assembly  and  C,  to  make  it 
more  computationally  efficient 
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APPENDIX 


PROOFS  OF  THEOREMS 


A-0 


Proof  of  Lemma  1 


It  is  obvious  that  for  the  first  person  selected  by  the  gradient  approach,  person  iu  we  have  the 
equality 


where  j\  is  the  assignment  to  the  person  ix  by  the  gradient  approach.  Then  for  the  second  person,  per¬ 
son  /2,  we  will  have  the  equalities 


Ci2t2  ~ 


min 


=  mm  c; 


where  j2  is  the  assignment  to  the  person  i2.  The  second  equality  is  due  to  assumed  monotonicity.  Thus 
in  both  cases  we  have  assigned  persons  to  minimizing  jobs.  If  we  continue  this  consideration,  by  induc¬ 
tion  we  will  get  Lemma  1. 


Proof  of  Lemma  2 

Let  the  initial  solution  of  the  gradient  approach  be  h  where  jk  is  the  job  assigned  to 

the  person  k .  Without  lost  of  generality,  we  can  assume  that  person  k  is  being  assigned  at  stage  k  of 
the  algorithm.  Assume  that  assignment  \  is  not  optimal;  that  is,  there  is  an  assignment 

t . jn  K  the  cost  of  which  is  less  than  that  of  assignment  \j  \  Let  r  be  the  person,  such  that 

jr  —  ju  then  consider  a  new  assignment: 

UljlJ*  •  •  •  •  •  •  >jn  (1A) 

Assignment  (1A)  differs  from  the  original  assignment  ■{jj,  .  .  .  ,jn  ^  by  elementary  permutation  (l,r ). 

By  definition  of  the  gradient  approach  we  have 

Cl>i  ~  ci7f 

If  in  addition  to  that  we  have 

Crf\  ~  Cr7r  =  CW  (2A) 

we  see  that  the  cost  of  assignment  (1A)  is  not  more  than  the  cost  of  {fi,  .  . .  ,Jn 

If  contrary  to  inequality  (2A)  we  have: 


A-l 


Crj1  >  Crj1*  (3 A) 

then  due  to  the  lemma  conditions, 

crh  “  Crh  <cVl~ 
or 


Crjl  +  CUi  <  Crjl  +  Clj1-  Crjr  +  C\ jf 

which  also  shows  that  assignment  (1A)  cost  less  than  assignment  ...  Jn  h  Repeating  this  process 
with  elementary  permutations  not  more  than  n  times,  we  will  get  assignment  ^  out  of  assign¬ 

ment  fc/i,  .  .  .  ,jn  ^  Because  at  every  step  of  this  process  the  cost  of  intermediate  assignment  is  decreas¬ 
ing,  we  will  finally  contradict  our  assumption  (3A),  which  proves  the  Lemma. 

Proof  of  Lemma  4. 

Let  {/i,  .  .  .  tjn  ^  be  an  assignment  obtained  from  the  original  assignment  .  .  .  ,jn  ^  with  the 
help  of  elementary  permutation  (rjc);  that  is,  Jr  =  jk;  Jk  =  jr  and  Ji  =  ji  for  i  *  r\  i  *k. 

If  contrary  to  the  Lemma  we  have 

H  ~  CrJk  ~  crTr' 

then  we  should  get 

ckjk  >  Ckjr  =  ckJk .  (4 A) 

This  is  because  in  the  other  case,  the  cost  of  assignment  \jl9  .  .  .  Jn  will  not  be  less  than  the  cost  of 

the  original  assignment  K  which  contradicts  the  assumption  of  the  improving  chain.  But  ine¬ 

quality  (4A)  differs  from  the  Lemma’s  statement  only  in  renumeration  of  persons,  which  proves  the 
Lemma.  Indeed,  if  we  denote  person  k  as  person  r  and  vice  versa,  statement  (4A)  will  coincide  with 
the  Lemma  statement. 
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